How to solve novel problems: the role of associative learning in problem-solving performance in wild great tits Parus major.

Although problem-solving tasks are frequently used to assess innovative ability, the extent to which problem-solving performance reflects variation in cognitive skills has been rarely formally investigated. Using wild breeding great tits facing a new non-food motivated problem-solving task, we investigated the role of associative learning in finding the solution, compared to multiple other non-cognitive factors. We first examined the role of accuracy (the proportion of contacts made with the opening part of a string-pulling task), neophobia, exploration, activity, age, sex, body condition and participation time on the ability to solve the task. To highlight the effect of associative learning, we then compared accuracy between solvers and non-solvers, before and after the first cue to the solution (i.e., the first time they pulled the string opening the door). We finally compared accuracy over consecutive entrances for solvers. Using 884 observations from 788 great tits tested from 2010 to 2015, we showed that, prior to initial successful entrance, solvers were more accurate and more explorative than non-solvers, and that females were more likely to solve the task than males. The accuracy of solvers, but not of non-solvers, increased significantly after they had the opportunity to associate string pulling with the movement of the door, giving them a first cue to the task solution. The accuracy of solvers also increased over successive entrances. Our results demonstrate that variations in problem-solving performance primarily reflect inherent individual differences in associative learning, and are also to a lesser extent shaped by sex and exploratory behaviour.

Cue duration and trial spacing effects in contingency assessment in the streaming procedure with humans.

According to the cycle/trial (C/T) rule, the rate of associative learning is a function of the ratio between the overall rate of U.S. presentation (C) and its rate in the presence of the conditioned stimulus (CS; [T]). This rule is well supported in studies with nonhumans. The present study was conducted to test whether it also applies to human contingency learning. In Experiment 1, participants were exposed to rapid streams of trials. Sensitivity to the cue-outcome contingency varied with both intertrial interval (ITI, which captures C) and cue duration, but the C/T rule was not respected, notably because the effect of ITI was much larger than the effect of cue duration. Experiment 2 showed that mere suppression of verbal strategies did not alter the magnitude of the ITI effect. Experiment 3 replicated Experiment 1 but with cue duration and ITI varied between 1,000 and 3,000 ms instead of between 100 and 1,000 ms. Performance was insensitive to both cue duration and ITI. This was not the consequence of Experiment 3 only varying the cue duration to ITI ratio by a factor of 3; in Experiment 4 where the cue duration was 100 ms, a 300-ms ITI was sufficient to observe an ITI effect. The lack of an ITI effect with a 1,000-ms cue and an ITI varying between 1,000 and 3,000 ms was replicated in Experiment 5. These results are discussed in light of how processes underlying associative learning might break down when events occur very rapidly. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

An analysis of reinstatement after extinction of a conditioned taste aversion.

Taste aversion learning has sometimes been considered a specialized form of learning. In several other conditioning preparations, after a conditioned stimulus (CS) is conditioned and extinguished, reexposure to the unconditioned stimulus (US) by itself can reinstate the extinguished conditioned response. Reinstatement has been widely studied in fear and appetitive Pavlovian conditioning, as well as operant conditioning, but its status in taste aversion learning is more controversial. Six taste-aversion experiments with rats therefore sought to discover conditions that might encourage it there. The results often yielded little to no evidence of reinstatement, and we also found no evidence of concurrent recovery, a related phenomenon in which responding to a CS that has been conditioned and extinguished is restored if a second CS is separately conditioned. However, a key result was that reinstatement occurred when the conditioning procedure involved multiple closely spaced conditioning trials that could have allowed the animal to learn that a US presentation signaled or set the occasion for another trial with a US. Such a mechanism is precluded in many taste aversion experiments because they often use very few conditioning trials. Overall, the results suggest that taste aversion learning is experimentally unique, though not necessarily biologically or evolutionarily unique. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Changes in responses of the amygdala and hippocampus during fear conditioning are associated with persecutory beliefs.

The persecutory delusion is the most common symptom of psychosis, yet its underlying neurobiological mechanisms are poorly understood. Prior studies have suggested that abnormalities in medial temporal lobe-dependent associative learning may contribute to this symptom. In the current study, this hypothesis was tested in a non-clinical sample of young adults without histories of psychiatric treatment (n = 64), who underwent classical Pavlovian fear conditioning while fMRI data were collected. During the fear conditioning procedure, participants viewed images of faces which were paired (the CS+) or not paired (the CS-) with an aversive stimulus (a mild electrical shock). Fear conditioning-related neural responses were measured in two medial temporal lobe regions, the amygdala and hippocampus, and in other closely connected brain regions of the salience and default networks. The participants without persecutory beliefs (n = 43) showed greater responses to the CS- compared to the CS+ in the right amygdala and hippocampus, while the participants with persecutory beliefs (n = 21) failed to exhibit this response. These between-group differences were not accounted for by symptoms of depression, anxiety or a psychosis risk syndrome. However, the severity of subclinical psychotic symptoms overall was correlated with the level of this aberrant response in the amygdala (p = .013) and hippocampus (p = .033). Thus, these findings provide evidence for a disruption of medial temporal lobe-dependent associative learning in young people with subclinical psychotic symptoms, specifically persecutory thinking.

Conditioning and pseudoconditioning differently change intrinsic excitability of inhibitory interneurons in the neocortex.

Many studies indicate a broad role of various classes of GABAergic interneurons in the processes related to learning. However, little is known about how the learning process affects intrinsic excitability of specific classes of interneurons in the neocortex. To determine this, we employed a simple model of conditional learning in mice where vibrissae stimulation was used as a conditioned stimulus and a tail shock as an unconditioned one. In vitro whole-cell patch-clamp recordings showed an increase in intrinsic excitability of low-threshold spiking somatostatin-expressing interneurons (SST-INs) in layer 4 (L4) of the somatosensory (barrel) cortex after the conditioning paradigm. In contrast, pseudoconditioning reduced intrinsic excitability of SST-LTS, parvalbumin-expressing interneurons (PV-INs), and vasoactive intestinal polypeptide-expressing interneurons (VIP-INs) with accommodating pattern in L4 of the barrel cortex. In general, increased intrinsic excitability was accompanied by narrowing of action potentials (APs), whereas decreased intrinsic excitability coincided with AP broadening. Altogether, these results show that both conditioning and pseudoconditioning lead to plastic changes in intrinsic excitability of GABAergic interneurons in a cell-specific manner. In this way, changes in intrinsic excitability can be perceived as a common mechanism of learning-induced plasticity in the GABAergic system.

A translational and multidisciplinary approach to studying the Garcia effect, a higher form of learning with deep evolutionary roots.

Animals, including humans, learn and remember to avoid a novel food when its ingestion is followed, hours later, by sickness - a phenomenon initially identified during World War II as a potential means of pest control. In the 1960s, John Garcia (for whom the effect is now named) demonstrated that this form of conditioned taste aversion had broader implications, showing that it is a rapid but long-lasting taste-specific food aversion with a fundamental role in the evolution of behaviour. From the mid-1970s onward, the principles of the Garcia effect were translated to humans, showing its role in different clinical conditions (e.g. side-effects linked to chemotherapy). However, in the last two decades, the number of studies on the Garcia effect has undergone a considerable decline. Since its discovery in rodents, this form of learning was thought to be exclusive to mammals; however, we recently provided the first demonstration that a Garcia effect can be formed in an invertebrate model organism, the pond snail Lymnaea stagnalis. Thus, in this Commentary, after reviewing the experiments that led to the first characterization of the Garcia effect in rodents, we describe the recent evidence for the Garcia effect in L. stagnalis, which may pave the way for future studies in other invertebrates and mammals. This article aims to inspire future translational and ecological studies that characterize the conserved mechanisms underlying this form of learning with deep evolutionary roots, which can be used to address a range of different biological questions.

Palatability attributed to alcohol and alcohol-paired flavors.

The orosensory features of alcoholic drinks are potent relapse triggers because they acquire incentive properties during consumption, including enhanced palatability. Whether mice similarly perceive alcoholic drinks to be more palatable after repeated consumption is complicated by reports showing that alcohol elicits aversive taste reactivity responses and conditions flavor avoidance. Here, by analyzing the microstructure of alcohol consumption, we report a gradual increase in lick bout duration relative to water that is partially maintained by an alcohol-paired flavor in extinction. We interpret lick bout duration to reflect an increase in the palatability alcohol and an alcohol-paired flavor. This finding demonstrates that bout duration is amenable to Pavlovian conditioning and highlights the importance of considering the microstructure of alcohol consumption in preclinical models of alcohol misuse.

Mouse Model of Chronic Social Stress-Induced Excessive Pavlovian Aversion Learning-Memory.

Increased experience of aversive stimuli/events is a psychological-neurobiological state of major importance in psychiatry. It occurs commonly in generalized anxiety disorder, post-traumatic stress disorder, and major depression. A sustained period of exposure to threat (chronic stressor) is a common risk factor, and a major symptom is generalized excessive perception of, and reactivity to, aversive stimuli. In rodents, Pavlovian aversion learning and memory (PAL, PAM), quantified in terms of the conditioned defensive behavior freezing, is an extensively studied behavioral paradigm, and well understood in terms of underlying neural circuitry. In mice, chronic social stress (CSS) is a 15-day resident-intruder paradigm in which C57BL/6 adult males are exposed continuously and distally to dominant-aggressive CD-1 male mice (sustained threat) interspersed with a brief daily period of proximal attack (acute threat). To ensure that physical wounding is minimized, proximal attacks are limited to 30 to 60 s/day and lower incisor teeth of CD-1 mice are blunted. Control (comparison) mice are maintained in littermate pairs. The CSS and CD-1 mice are maintained in distal contact during subsequent behavioral testing. For PAL, CSS and control (CON) mice are placed in a conditioning chamber (context) and exposed to a tone [conditioned stimulus (CS)] and mild, brief foot shock [unconditioned stimulus (US)]. For PAM, mice are placed in the same context and presented with CS repetitions. The CSS mice acquire (learn) and express (memory) a higher level of freezing than CON mice, indicating that CSS leads to generalized hypersensitivity to aversion, i.e., chronic social aversion leads to increased aversion salience of foot shock. Distinctive features of the model include the following: high reproducibility; rare, mild wounding only; male specificity; absence of "susceptible" vs "resilient" subgroups; behavioral effects dependent on continued presence of CD-1 mice; and preclinical validation of novel compounds for normalizing aversion hypersensitivity with accurate feedforward prediction of efficacy in human patients. © 2024 The Authors. Current Protocols published by Wiley Periodicals LLC. Basic Protocol 1: Chronic social stress (CSS) Basic Protocol 2: Pavlovian aversion learning and memory (PALM).

CK2 negatively regulates the extinction of remote fear memory.

Cognitive behavioral therapy, rooted in exposure therapy, is currently the primary approach employed in the treatment of anxiety-related conditions, including post-traumatic stress disorder (PTSD). In laboratory settings, fear extinction in animals is a commonly employed technique to investigate exposure therapy; however, the precise mechanisms underlying fear extinction remain elusive. Casein kinase 2 (CK2), which regulates neuroplasticity via phosphorylation of its substrates, has a significant influence in various neurological disorders, such as Alzheimer's disease and Parkinson's disease, as well as in the process of learning and memory. In this study, we adopted a classical Pavlovian fear conditioning model to investigate the involvement of CK2 in remote fear memory extinction and its underlying mechanisms. The results indicated that the activity of CK2 in the medial prefrontal cortex (mPFC) of mice was significantly upregulated after extinction training of remote cued fear memory. Notably, administration of the CK2 inhibitor CX-4945 prior to extinction training facilitated the extinction of remote fear memory. In addition, CX-4945 significantly upregulated the expression of p-ERK1/2 and p-CREB in the mPFC. Our results suggest that CK2 negatively regulates remote fear memory extinction, at least in part, by inhibiting the ERK-CREB pathway. These findings contribute to our understanding of the underlying mechanisms of remote cued fear extinction, thereby offering a theoretical foundation and identifying potential targets for the intervention and treatment of PTSD.

The ventromedial prefrontal cortex in response to threat omission is associated with subsequent explicit safety memory.

In order to memorize and discriminate threatening and safe stimuli, the processing of the actual absence of threat seems crucial. Here, we measured brain activity with fMRI in response to both threat conditioned stimuli and their outcomes by combining threat learning with a subsequent memory paradigm. Participants (N = 38) repeatedly saw a variety of faces, half of which (CS+) were associated with an aversive unconditioned stimulus (US) and half of which were not (CS-). When an association was later remembered, the hippocampus had been more active (than when forgotten). However, the ventromedial prefrontal cortex predicted subsequent memory specifically during safe associations (CS- and US omission responses) and the left dorsolateral prefrontal cortex during outcomes in general (US and US omissions). In exploratory analyses of the theoretically important US omission, we found extended involvement of the medial prefrontal cortex and an enhanced functional connectivity to visual and somatosensory cortices, suggesting a possible function in sustaining sensory information for an integration with semantic memory. Activity in visual and somatosensory cortices together with the inferior frontal gyrus also predicted memory performance one week after learning. The findings imply the importance of a close interplay between prefrontal and sensory areas during the processing of safe outcomes-or 'nothing'-to establish declarative safety memory.

Impact of enriched environment on motor performance and learning in mice.

Neuroscience heavily relies on animal welfare in laboratory rodents as it can significantly affect brain development, cognitive function and memory formation. Unfortunately, laboratory animals are often raised in artificial environments devoid of physical and social stimuli, potentially leading to biased outcomes in behavioural assays. To assess this effect, we examined the impact of social and physical cage enrichment on various forms of motor coordination. Our findings indicate that while enriched-housed animals did not exhibit faster learning in eyeblink conditioning, the peak timing of their conditioned responses was slightly, but significantly, improved. Additionally, enriched-housed animals outperformed animals that were housed in standard conditions in the accelerating rotarod and ErasmusLadder test. In contrast, we found no significant effect of enrichment on the balance beam and grip strength test. Overall, our data suggest that an enriched environment can improve motor performance and motor learning under challenging and/or novel circumstances, possibly reflecting an altered state of anxiety.

Renewal in human fear conditioning: A systematic review and meta-analysis.

Renewal is a 'return of fear' manipulation in human fear conditioning to investigate learning processes underlying anxiety and trauma. Even though renewal paradigms are widely used, no study has compared the strength of different renewal paradigms. We conduct a systematic review (N = 80) and meta-analysis (N = 23) of human fear conditioning studies assessing renewal. Our analysis shows that the classic ABA design is the most effective paradigm, compared to ABC and ABBA designs. We present evidence that conducting extinction in multiple contexts and increasing the similarity between acquisition and extinction contexts reduce renewal. Furthermore, we show that additional cues can be used as safety and 'protection from extinction' cues. The review shows that alcohol weakens the extinction process and that older adults appear less sensitive to context changes and thus show less renewal. The large variability in approaches to study renewal in humans suggests that standardisation of fear conditioning procedures across laboratories would be of great benefit to the field.

[Learning and Neural Activity: Beyond Localization].

Learning is classified into two types: "classical conditioning," which modifies simple reflexes, and "operant conditioning," which modifies complex voluntary behaviors. The neural circuits underlying these two types differ significantly. During the learning process of operant conditioning tasks, various changes in firing rate and firing synchrony of neurons can be observed across multiple brain regions. Additionally, neuronal firing rate and synchrony in several brain regions can be voluntarily controlled through operant conditioning. Consequently, it is evident that neurons in widespread brain regions have the potential for plastic changes to facilitate learning. It may be suggested that the learning of complex voluntary behaviors is underlined by widespread dynamic changes in neural activity and is not restricted to only a few brain regions.

Synergistic negative effects between a fungicide and high temperatures on homing behaviours in honeybees.

Interactions between environmental stressors may contribute to ongoing pollinator declines, but have not been extensively studied. Here, we examined the interaction between the agricultural fungicide Pristine (active ingredients: 25.2% boscalid, 12.8% pyraclostrobin) and high temperatures on critical honeybee behaviours. We have previously shown that consumption of field-realistic levels of this fungicide shortens worker lifespan in the field and impairs associative learning performance in a laboratory-based assay. We hypothesized that Pristine would also impair homing and foraging behaviours in the field, and that an interaction with hot weather would exacerbate this effect. Both field-relevant Pristine exposure and higher air temperatures reduced the probability of successful return on their own. Together, the two factors synergistically reduced the probability of return and increased the time required for bees to return to the hive. Pristine did not affect the masses of pollen or volumes of nectar or water brought back to the hive by foragers, and it did not affect the ratio of forager types in a colony. However, Pristine-fed bees brought more concentrated nectar back to the hive. As both agrochemical usage and heat waves increase, additive and synergistic negative effects may pose major threats to pollinators and sustainable agriculture.

Auditory aversive generalization learning prompts threat-specific changes in alpha-band activity.

Pairing a neutral stimulus with aversive outcomes prompts neurophysiological and autonomic changes in response to the conditioned stimulus (CS+), compared to cues that signal safety (CS-). One of these changes-selective amplitude reduction of parietal alpha-band oscillations-has been reliably linked to processing of visual CS+. It is, however, unclear to what extent auditory conditioned cues prompt similar changes, how these changes evolve as learning progresses, and how alpha reduction in the auditory domain generalizes to similar stimuli. To address these questions, 55 participants listened to three sine wave tones, with either the highest or lowest pitch (CS+) being associated with a noxious white noise burst. A threat-specific (CS+) reduction in occipital-parietal alpha-band power was observed similar to changes expected for visual stimuli. No evidence for aversive generalization to the tone most similar to the CS+ was observed in terms of alpha-band power changes, aversiveness ratings, or pupil dilation. By-trial analyses found that selective alpha-band changes continued to increase as aversive conditioning continued, beyond when participants reported awareness of the contingencies. The results support a theoretical model in which selective alpha power represents a cross-modal index of continuous aversive learning, accompanied by sustained sensory discrimination of conditioned threat from safety cues.

The irreconcilability of insight.

We are said to experience insight when we suddenly and unexpectedly become aware of the solution to a problem that we previously took ourselves to be unable to solve. In the field of comparative cognition, there is rising interest in the question of whether non-human animals are capable of insightful problem-solving. Putative cases of animals demonstrating insight have generally attracted two types of criticism: first, that insight is being conflated with other cognitive capacities (e.g., causal cognition, or mental trial and error); and, second, that the relevant performances merely reflect associative learning-and on the received understanding of insight within comparative cognition, insight necessarily involves non-associative processes. I argue that even if we grant that some cases of animal insight do withstand these two criticisms, these cases of purported animal insight cannot shed light on the nature of insightful problem-solving in humans. For the phenomenon studied by cognitive psychologists under the heading of insight is fundamentally different from that studied in comparative cognition. In light of this impasse, I argue that the reinterpretation of the extant research on animal insight in terms of other high-level cognitive capacities (means-end reasoning in particular) can improve the prospect of a successful comparative research program.

Fear generalization predicts post-traumatic stress symptoms: A two-year follow-up study in Dutch fire fighters.

INTRODUCTION: Excessive fear generalization has been associated with pathological anxiety, including posttraumatic stress disorder (PTSD). However, studies investigating the longitudinal relationship between generalization and the development of anxiety symptomatology are scarce. This study aims to test the predictive value of fear generalization for PTSD symptoms in a high-risk profession sample and to explore the relationship between generalization and neuroticism, which are both linked to PTSD. METHOD: Longitudinal data from a multi-wave study in 529 Dutch fire-fighters were used. Fear generalization, PTSD symptoms and neuroticism were assessed at baseline. PTSD symptoms were reevaluated at six, 12, 18, and 24 months. Generalization was assessed in a differential conditioning paradigm by measuring expectancies of an aversive outcome when presented with stimuli similar to previously conditioned stimuli. RESULTS: Higher expectancy ratings towards stimuli most similar to safety signals predicted PTSD symptoms at follow-up after controlling for baseline PTSD symptoms, whereas higher expectancy ratings towards stimuli most similar to danger signals was associated with neuroticism. Neuroticism weakened the predictive power of fear generalization when considered simultaneously. DISCUSSION: These findings suggest that heightened fear generalization is associated with the development of anxiety and trauma-related symptoms. Targeting problematic fear generalization may be a promising intervention approach.

Pavlovian-to-instrumental transfer in individuals with chronic pain.

Avoidance of pain has been argued to be key factor leading pain events to chronic disability. In this respect, research has focused on investigating the working mechanisms of avoidance's acquisition. Avoidance of painful stimuli has been traditionally studied using a combination of Pavlovian and Instrumental procedures. However, such approach seems to go against real-life scenarios where avoidance is commonly acquired more readily. Using a novel pain avoidance paradigm, we tested whether pain avoidance can be installed in absence of associations between a cue and pain omission, and whether such avoidance differs between pain patients and healthy controls. Participants first learned to avoid painful stimuli by pressing a grip bar. Then, they passively encountered pairings of one geometrical shape with pain and of another geometrical shape without pain. Lastly, participants encountered the geometrical shapes while being able to use the grip bar. Results showed that participants pressed the bar more vigorously when encountering the previously pain-related shape compared to the pain-unrelated shape. This effect did not seem to differ between pain patients and healthy control. Our study could inspire a new way in measuring avoidance in pain, possibly paving the way to better understanding how avoidance is installed in chronic pain.

Formation of memory assemblies through the DNA-sensing TLR9 pathway.

As hippocampal neurons respond to diverse types of information1, a subset assembles into microcircuits representing a memory2. Those neurons typically undergo energy-intensive molecular adaptations, occasionally resulting in transient DNA damage3-5. Here we found discrete clusters of excitatory hippocampal CA1 neurons with persistent double-stranded DNA (dsDNA) breaks, nuclear envelope ruptures and perinuclear release of histone and dsDNA fragments hours after learning. Following these early events, some neurons acquired an inflammatory phenotype involving activation of TLR9 signalling and accumulation of centrosomal DNA damage repair complexes6. Neuron-specific knockdown of Tlr9 impaired memory while blunting contextual fear conditioning-induced changes of gene expression in specific clusters of excitatory CA1 neurons. Notably, TLR9 had an essential role in centrosome function, including DNA damage repair, ciliogenesis and build-up of perineuronal nets. We demonstrate a novel cascade of learning-induced molecular events in discrete neuronal clusters undergoing dsDNA damage and TLR9-mediated repair, resulting in their recruitment to memory circuits. With compromised TLR9 function, this fundamental memory mechanism becomes a gateway to genomic instability and cognitive impairments implicated in accelerated senescence, psychiatric disorders and neurodegenerative disorders. Maintaining the integrity of TLR9 inflammatory signalling thus emerges as a promising preventive strategy for neurocognitive deficits.

Adolescents flexibly adapt action selection based on controllability inferences.

From early in life, we encounter both controllable environments, in which our actions can causally influence the reward outcomes we experience, and uncontrollable environments, in which they cannot. Environmental controllability is theoretically proposed to organize our behavior. In controllable contexts, we can learn to proactively select instrumental actions that bring about desired outcomes. In uncontrollable environments, Pavlovian learning enables hard-wired, reflexive reactions to anticipated, motivationally salient events, providing "default" behavioral responses. Previous studies characterizing the balance between Pavlovian and instrumental learning systems across development have yielded divergent findings, with some studies observing heightened expression of Pavlovian learning during adolescence and others observing a reduced influence of Pavlovian learning during this developmental stage. In this study, we aimed to investigate whether a theoretical model of controllability-dependent arbitration between learning systems might explain these seemingly divergent findings in the developmental literature, with the specific hypothesis that adolescents' action selection might be particularly sensitive to environmental controllability. To test this hypothesis, 90 participants, aged 8-27, performed a probabilistic-learning task that enables estimation of Pavlovian influence on instrumental learning, across both controllable and uncontrollable conditions. We fit participants' data with a reinforcement-learning model in which controllability inferences adaptively modulate the dominance of Pavlovian versus instrumental control. Relative to children and adults, adolescents exhibited greater flexibility in calibrating the expression of Pavlovian bias to the degree of environmental controllability. These findings suggest that sensitivity to environmental reward statistics that organize motivated behavior may be heightened during adolescence.